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@ RAotion compensation encoding method and apparatus adaptive to motion amount 



@ A nrK)tion compensating encoding apparatus 
adaptive to a motbn amount adaptively gener- 
ates motion-compensated pixel values for per- 
fonming differential pulse code modulation of 
pixel values of a current Image even when a 
current image motion amount to be motion- 
compensated with respect to a reference image 
is beyorKj a predetenmined motion amount The 
motion compensation encoding apparatus in- 
cludes a global nK>tion estimator (53) for 
generating a global nfK)tion vector representing 
spatial position difference between the refer- 
ence innage according to the pixel values ^red 
in a first memory (17) and the current image 
according to the pixel values stored in a second 
n>enrK)ry (56), nx)tion^mpensating the refer- 
ence in^ge on the basis of the generated global 
motion vector and storing the pixel values of the 
motion-compensated reference image, a local 
motion estimator (54) for generating a local 
motion vector according to comparison of the 
pixel values between a current video block 
which is fonned by the pixel values supplied 
from the second memory (56), and which has a 
size smaller than the current image and a 
search area fonmed by part of the pixel values 
stored in the global motion estimator (53), a 
motion compensator (55) for receiving the local 
motion vector from ttie local motion estimator 
(54) and generating motion-compensated pixel 
values by i^ing the pixel values stored in the 
global motion estimator (53) and the local mo- 
tion vector, and a unit (31) for generating a 
difference value l>etween the respective pixel 
values of each image secondly ou^ut from the 
second mennory {56) and the conresponding 
nfK)tion-compensated pixel values output from 
the nrKstion compensator (55). 
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The present invention relates to a motion compensatbn encoding method which is adaptive to an amount 
of motion and the apparatus thereof, and more particularly, though not exclusively, to a rrK>tion compensation 
encoding method for use in a differential pulse encoded video signal capable of adaptively performing a nK)tlon 
compensation encoding operation even when an anrwunt of motion between images Is beyond a predetermined 
5 amount of motion. 

In a recent system, a video signal is usually encoded into digital data and then processed to improve a 
quality of the picture. However, when the video signal is encoded into the digital data, an anK>unt of data be- 
comes considerably large. To solve such a problem, a conventional video encoding system utilizes a transfor- 
mation encoding method, a differential pulse code modulation (DPCM) method, a vector quantization method 

10 and a variable length coding (VLC) method, thereby removing redundancy data included in a digital video signal 
to reduce an amount of the total data. Referring to Figure 1, a conventional motion image encoder having a 
well-known structure will t>e described below. 

One frame digital video signal is reconstructed as M x N pbcels. Pbcel values of the reconstructed video 
blocks are stored in memory 10. The pixel values stored in memory 10 are applied to a nx»tion estimator 18, 

15 a subtracter 31 and a ratio controller 20. Motion estimator 18 uses pixel values of a current image suppli^ 
from memory 10 and pbcel values of a reference image stored in a frame memory 17, to estimate an amount 
of motion with respect to the respective video triocks of the current image. Motnn estimation is performed on 
the baste of correlation between frames. Motion estimator 18 finds a reference video block having image in- 
formation nearly identical to that of a current video block used for comparison in a search area which becomes 

20 a part of the reference image, to then generate a motion vector MV representing a spatial positton difference 
between the current video block and the reference video block. A motion compensator 19 reads pbcel values 
of the reference video block which is designated by motton vector MV produced by motion estimator 1 8, from 
frame memory 1 7. The read pixel values are output to subtracter 31. Subtracter 31 subtracts a corresponding 
pbcel value applied from motion compensator 19 from a pixel value supplied from memory 1 0 for a differential 

25 pulse code nrxxjulation and outputs a differential pbcel value obtained by substraction to a transformer 11. A 
transformer 11 transforms spatial region pixel values supplied from subtracter 31 into frequency region trans- 
form coefficient values. Transformer 11 uses one among a discrete cosine transform (DCT) method, a Walsh- 
Hadamard transform (WHT) nrwthod, a discrete Fourier transform (DFT) method or a discrete sine transform 
(DST) method, to perform a transform operation in units of a video block having M x N pbcels. The transform 

30 coefficient values output from transfornter 11 are quantized by a quantizer 12 to then be supplied to a variable- 
length coder 13 and an inveree quantizer 15. Quantizer 12 and inverse quantizer 15 quantizes and inverse- 
quantizes respectively the input data acxx)rding to a quantization control signal Qss applied from ratb controller 
20. 

Since technologies in connection with quantizer 12 and inverse quantizer 15 are well known, detailed d&- 

35 scriptk)ns thereof will be omitted. Variable-length coder 1 3 variable-length-codes the input data. A buffer 14 
temporarily stores the data output from variable-length coder 13 prior to being transmitted, and outputs a buffer 
fullness representing a storage state of buffer 14 to ratio controller 20. Ratio controller 20 generates a control 
signal Qss for quantizatkin on the basis of the pbcel values supplied from memory 10 and the buffer fullness 
applied from buffer 14. On the other hand an inverse transformer 16 performs an inverse transfbnm of the trans- 

40 form coefficient values applied from inverse quantizer 15 with respect to the transform by transformer 11 . to 
generate spatial regbn pbcel values. An adder 32 adds pbcel values applied from motion compensator 19 and 
pbcel values applied from inverse transformer 16, to then output the result to frame memory 17. Frame menrwry 
17 stores the pixel values applied from adder 32. The quantization control signal generated by ratio controller 
20, nrK3tion vector MV generated by nrK>tk)n estimator 1 8 and output data Vc of buffer 14 are supplied to a video 

45 decoder shown in Figure 2. Switches 33 and 34 are used for reducing the difference t>etween an image prior 
to being encoded by differential pulse code rrKxlulation in the motion picture encoder shown in Figure 1 and 
an image after decoding in the decoder shown in Figure 2. 

In the n[K>tion de<:oder of Figure 2, variable-length decoder 21 variable-length-decodes data Vc output from 
buffer 14. An inverse quantizer 22 and in inverse transformer 23 perform the same function as those of inverse 

50 quantizer 15 and inverse transformer 16 of Figure 1 , respectively. Motion compensator 24 reads pbcel values 
from frame menwry 25 corresponding to motk)n vector MV to supply the read pbcel values to an adder 26. Adder 
26 adds the output data of motion compensator 24 to the output data of inverse transfonmer 23, to output the 
result to a display and frame memory 25. A switch 27 is used for the same purpose as those of above switches 
33 and 34. 

55 Since the nation image encoder shown in Figure 1 uses a search area composed of the number of pbcels 
smaller than one f ranr^e to find a reference video btock having the same in^ge information as that of a current 
video block, a reference video block having the same image information as that of the current video t>lcx:k does 
not exist in a given search area, in case of a fast moving picture or a whole faning picture such as sports. The 
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Figure 1 motion image encoder does not perform a non-intracoding operation whbh obtains a difference value 
between image frames by using differential pulse code modulation with respect to the current video block, but 
performs an intracoding operation. Accordingly, an annount of bits of the encoded data becomes large. Such 
a problem lowers a total quality of picture and heightens a probability of occurrence of an overflow in buffer 
5 14, in a system by a predetermined data standard which uses a proper combination of an Intracoding and a 
non-intracoding. 

It is an aim of preferred embodiments of the present invention to provide a nDotion compensation encoding 
method which estimates an amount of nration with respect to a video block to be nratlon-compensatnn-en- 
coded and Is adaptive to an anrwunt of motion for generating the motion-compensated data, in which a global 
10 motion vector representing displacement between the frames is generated by altering a nrwtbn estimation 
range into a whole frame in case of an image having a large amount of rrK)tk)n between frames, and using 
data of the frame motk>n-compensated by the generated global motion vector. 

It Is another aim of preferred embodiments of the present invention to provide an apparatus embodying 
the aforementbned method. 

15 It is still another aim of preferred embodiments of the present invention to provkJe a nfK>tk>n compensation 
encoding apparatus which Is adaptive to an anrKHint of motton for generating motk>n-compensated data by gen- 
erating a reference image which Is obtained by compensating spatial position difference between an image 
to be motion-compensated and an image which becomes a reference of motion compensation. 

According to a first aspect of the present Invention, there is provided a nrK)tk)n compensation encoding 
20 apparatus for use in an image encoder for performing differential pulse code nK)dulatk)n by using pixel values 
of a current Image and motbn-compensated pixel values, the motion compensation encoder comprising: 
a first memory for storing pixel values of a reference innage; 

a second memory for storing pixel values with respect to a plurality of images, and repetitively outputting 
the stored pixel values of each Image one-frame by one-frame at least twice; 
25 global nrK)tion estimation means for generating a gbbal motion vector representing spatial position dif- 

ference t>etween the reference Image according to the pixel values stored In the first memory and the current 
image according to the pbcel values stored in the second memory, motion-compensating the reference image 
on the basis of the generated global nrwtbn vector and storing the pixel values of the motion-compensated 
reference iniage; 

30 local motion estimatk>n means for generating a local motion vector according to comparison of the pbcel 

values between a current video block which is formed by the pixel values supplied from the second memory, 
and whbh has a size smaller than the current Image and a search area fomrted by part of the pixel values stored 
In the global motion estimation means; 

nrK>tion compensation means for receiving the local nrtotion vector from the local motion estin^tion 

35 means and generating motiorvcompensated pixel values by using the pixel values stored in the global motion 
estimation means and the local nrwtlon vector; and 

means for generating a difference value between the respective pixel values of each image secondly 
output from the second memory and the corresponding motion-compensated pixel values output from the mo- 
tion compensation means. 

40 Suitat)ly, said global motbn estimator generates said local nrK>tion vector on the basis of a mean absolute 
error value according to pixel difference values between a plurality of a respectively moved current inr^ge ob- 
tained by movement within the motion estimation range and the reference image. 

Suitably, said global nrH)tion estimator generates said local nrK>tton vector on the basis of a mean square 
error value according to pixel difference values between a plurality of a respectively moved current image ob- 
45 tained by niovement within the nrK>tion estimation range and the reference image. 

According to a second aspect of the present invention, there is provided a motk>n compensatbn encoding 
apparatus for use In an image encoder for performing differential pulse code nK>dulatk>n by using pbcel values 
of a current Image and motion-compensated pixel values, the motion compensation encoder comprising: 
a first menK)ry for storing pixel values of a reference image; 
50 a second menrvory for storing pixel values with respect to a plurality of images, outputting the stored 

pbcel values of each image one-frame by one-frame, and outputting again the pixel values of each image output 
one-frame by one-frame once or twice more on the basis of a first control signal; 

nrK>tion discrimination means, coupled to receive the firstly output one-frame pbcel values atnong the 
duplicate pbcel values of the same image outputf rom the second nr>emory, for discriminating whether an amount 
55 of motion of the current image according to the pbcel values supplied from the second memory with respect 
to the reference image according to the pbcel values stored in the f irst memory, is beyond a predetermined 
anDOunt of motion, and generating first and second control signals according to the discrimination result; 

global motion estimation means for generating a gbbal motbn vector representing spatial position dif- 
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ference between the reference inr^age according to the pixel values stored in the first menK>ry and the current 
innage according to the pixel values stored in the second memory, and storing the pixel values of the niotion- 
compensated reference iniage on the basis of the generated global motion vector; 

local nrvotion estinnation nneans for discriminating whether the nfK>tion-compensated reference image is 
5 stored in the global nrK)tion estinration means, and generating one of a first local motion vector according to 
comparison of the pixel values between a current video block which formed by the pbcel values supplied from 
the second memory, and which has a size smaller than the current in^ge and a first search area fonmed by 
part of the pixel values stored in the first menfuu'y, and a second local motion vector according to comparison 
of the pixel values between the current video block and a second search area formed by part of the pixel values 
10 stored In the global nfK)tion estimation means, on the basis of the discrimination result; 

switching means for outputting the pixel values supplied from the second menK)ry to the local nrK)tion 
estimation nneans if the second control signal generated int he motion discrimination nr^ns represents that 
the current image motion amount is not beyond the predetermined motion amount, outputting one-frame pbcel 
values anrK)ng the pixel values oft eh same image supplied from the second menrKiry. if the second control 
IS signal represents that the current image motion amount is beyond the predetenmined nrK>tk>n anK)unt, and out- 
putting the following one-frame pbcel values to the \oca\ motion estinr^tk)n means; 

nrK)tion compensation means for generating motk)n-compensated pixel values by using the pixel values 
stored in the first memory and the first local nfK)tion vector if the first local motnn vector is applied from the 
local motion estimation means, and generating motk)n-compensated pbcel values stored in the global motion 
20 estimation means and the second local motk>n vector, if the second local motk>n vector is applied from the 
local motion estimation means; and 

nneans for generating a difference value between the respective pixel values of each image output from 
the second nnenrK)ry and the corresponding nK>tk>n-compensated pbcel values output from the nrK>tion compen- 
sation means. 

25 Suitably, said second menrK)ry outputs the pbcel values of the current image one-frame by one-frame twice 
if the first control signal represents that the current image motion amount is beyond the predetermined nrK>tion 
amount, while said second menrK>ry outputs the pbcel values of the current image of only one frame if the first 
control signal represents that the former is not beyond the tatter. 

Suitably, said motion discriminator generates the first control signal according to a result whether the first 
30 reference video block having the same image information as that of the current vkjeo \Aock exists in the first 
search area corresponding to the current video block. 

Suitably, said motk)n discriminator discriminates whether the first reference video block having the same 
image information with respect to a plurality of the current video block exists in the current image. 

Suitably, said global motion estimator generates said first local nrK>tion vector on the basis of a nnean ab- 
35 solute error value according to pbcel difference values between a plurality of a respectively moved current inrv 
age obtained by movement within the nrK>tion estimation range and the reference image. 

Suitably, said global motk>n estimator generates said first Icx^al motion vector on the basis of a mean square 
error value according to pbcel difference values between a plurality of a respectively nrK>ved current innage ob- 
tained by nnovement within the motion estimation range and the reference image. 
40 Suitably, said lcx:al motion estimator generates said first local motion vector if the nrwtion-oompensated 
reference image is not stored in sakl global motion estimator, while the form^ generates sakl second local 
motion vector if the nrK>tion-compensated reference image is stored in said latter. 

Acxxxding to a third aspect of the present inventk}n, there is provided a motion c:ompensatk>n encxxiing 
method for use in an image enccxjerfor performing differential pulse code modulatton by using pixel values 
45 of a current innage and motion-compensated pixel values, the motion compensation encxxiing method conv- 
prising the steps of: 

a) storing pbcel values of a reference image for motton compensatton; 

b) storing pbcel values of the current image; 

c) discriminating whether an amount of nrK)tk)n of the current image to be nr>otion-compensated is beyond 
50 a predetermined anK)unt of motion on the basis of all the pbcel values stored in steps a) and b); 

d) generating a global motk)n vector representing spatial positbn difference of the current image of the 
pbcel values stored in step b) with respect to the reference image of the pixel values stored in step a), if a 
discriminatk)n result of step c) represents that the current image nrK)tion amount is beyond the predeter- 
mined nK>tion annount; 

55 e) n[K>tion-compensating the reference image corresponding to the pixel value stored in step a) to store 
the pbcel values of the nrK3tion-<:ompensated reference image; 

f) generating a second local nrration vector on the basis of comparison of pixel values between a first video 
bl(x:k and a second search area formed by part of the pbcel values stored in step e); 
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g) generating motion-compensated pixel values by using the second local motion vector generated In step 
f) and the corresponding pixel values stored in step e); and 

h) generating a difference value between the respective pixel values of the current image stored in step 
b) and the corresponding pixel values of the motion-compensated reference image generated in step g). 

5 Suitably, said method further comprises the steps of: 

i) generating a first local motion vector on the basis of comparison of the pbcel values between the first 
video block which is formed by the pixel values stored In step b) and having a smaller size than that of the 
current image and a first search area fomr^ by a part of the pixel values stored in step a); 

j) generating the nwtion-compensated pixel values using the first local motion vector generated in step i) 
10 and the corresponding pbcel values stored in step a); and 

k) generating a difference value between the respective pixel values of the current image stored in step 
b) and the corresponding pbcel values of the motion-compensated reference image generated in step j), 
wherein a discrimination result of step c) represents that the current Image nnotion amount is not beyond 
the predetermined motion amount 
15 Suitably, said step c) comprises the sub-steps of: 

c1 ) forming the first search area for motion estimation of the current video block, and including the current 
video block having a part of the current image pixel values and a part of the pbcel values stored in step a); 
c2) discriminating whether the reference video block having the same image information as that of the cur- 
rent video block exists in the first search area on the basis of comparison of the image informatfon between 
20 the current video block pbcel values formed in sub^tep d) and the corresponding blocks which exist in the 
first search area and having the same number of pbcels as that of the current video block; and 
discriminating whether the current image motion amount is beyond the predetermined motion amount 
on the basis of the discriminatfon result of sub-step c2). 

Suitably, said sub-step c2) further comprises the sub-step of discriminating whether the first reference vid- 
25 eo block having the same image information with respect to a plurality of the current video blocks exists in the 
cujrrent image. 

Suitably, said step d) further comprises the sub-step of d1) generating the global motion vector on the basis 
of a mean absolute error value according to pbcel difference values between a plurality of a respectively moved 
current image obtained by movement of the current image within the predetermined motion estimation range 
30 and the reference image. 

Suitably, sub-step d1) comprises the sub-step of da1) calculating the mean absolute error value of the pbcel 
difference values between one current image by movement using the following equation and the reference 
image. 



MVik, 2) = min li'cur ^) "^rer I • 

m=0 n=0 ^ 

40 

-x_rang s k s x_rang-l, 

-y_rang sis y_rang-l (1) . 

45 in which Ycui(m, n) represents the (m, n)* pbcel value in the current image, and YreK^n, n) represents the 

(m, n)^ pixel value in the reference irr^ge, characters W and H represent the number of horizontal and v^ical 
pixels, respectively, and expressk)ns x_rang and y_rang represent a movement range of the current image 
with respect to the reference inr^ge in the horizontal and vertical directions, respectively. 

Suitably, step d) further comprises the sub-step of d2) generating the global motion vector on the basis 

50 of a mean square error value according to pixel difference values between a plurality of a respectively moved 
current image obtained by movement of the current image within the predetermined nrK)tk)n estimation range 
and the reference image. 

Suitably, said sub-step d2) comprises the sub-step of da2) calculating the mean square error value of the 
pixel difference values between one current innage by movement using the following equation and the refer- 
55 ence image, 
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MVik, 1) =min l^^cur ('"+*^'^+ J) "^xe/^^'^H^- 

5 

-x_rang s k s x_rang-l, 

-y_rang sis y_rang-l (2) . 

10 

in which Yajr(m, n) represents the (m, n)^ pixel value in the current image, and Yt^tn, n) represents the 
(m, n)**" pixel value in the reference iniage. characters W and H represent the number of horizontal and vertical 
pixels, respectively, and expressions x_rang and y_rang represent a movement range of the current image 
with respect to the reference image in the horizontal and vertical directions, respectively. 
15 Preferred embodiments of the present invention are described, by way of example only, with reference to 
the drawings, wherein: 

Figure 1 is a block diagram showing a conventional image encoding system. 
Figure 2 is a block diagram showing a conventional image decoding system. 

Figure 3 Is a block diagram showing a motion compensating encoding apparatus according to a preferred 
20 embodiment of the present invention. 

Figures 4A and 4B show a motion compensation encoding method which isadapthfe toan amount of nrK>tion 
according to the present invention. 

A preferred embodiment of the present invention will be described below in more detail with reference to 
the accompanying drawings Figures 3, 4A and 4B. 
25 Figure 3 shows a motion compensatton encoder according to a preferred embodiment of the present in- 
vention. In Figure 3, the like elements to Figure 1 use the like reference numerals thereto and the detailed 
description thereof will be omitted. 

Aconstructk>n and operation of the Figure 3 apparatus will be described below in connectk>n with the pres- 
ent invention. 

30 A menrK>ry 56 stores pixel values of a plurality of images. MenrK>ry 56 outputs the pbcel values of a prevk>us 
image anf>ong the stored pixel values to a ratio controller 20 and a subtracter 31, and outputs the pixel values 
of a current image to motk>n discriminator 51 . Subtracter 31 subtracts the corresponding pbcel values supplied 
from motion compensator 55 from the respective pixel values of the previous 'image supplied from memory 
31 and outputs a difference value to a transformer 11 . 

35 On the other hand, nrK>tk>n estimator 51 receives the pixel values of the reference innage stored in a frame 
memory 17 if the pixel values of the current image is supplied from memory 56 and discriminates an amount 
of motion of the current image with respect to the reference image. To discriminate the amount of motion of 
the current image with respect to the reference image, nrK>tion discriminator 51 discriminates whether a first 
reference vkteo bk>ck having the same image information as that of a current video block which becomes a 

40 part of the current Image exists In a first search area with respect to one or more current vkJeo blocks. Motion 
dtecriminator 51 generates a first control signal CTL1 representing whether motk)n estimation of the current 
image is possible using the pixel values of the reference image on the basis of the detection result. Motion 
discriminator 51 generates a second control signal CTL2 on the basis of the above discrimination result If first 
control signal CTL1 represents that the nnotlon estimation of the current image is possible using the pixel values 

45 of the refsrence image, memory 56 supplies the pixel values of the current image to a switch 52. Memory 56 
supplies the pbcel values of the current image again to a subtracter 31 after all the pixel values of the current 
image are supplied to switch 52. Switch 52 supplies the pbcel values of the current image supplied via an input 
end C from nnemory 56 to a local motk)n estimator 54 via a first output end A, according to the applied second 
control signal CTL2. Local motion estimator 54 discriminates whether the pbcel values of the compensated ref- 

50 erence image are stored in global motion estinrtator 53. If the pbcel values of the compensated reference image 
are not stored in global motion estimator 53 as a discrimination result, local motion estimator 54 uses the pixel 
values of the reference image stored in frame memory 17 and the pbcel values of the cninrent image applied 
via switch 52, and generates a first local motk>n vector LMV1 with respect to a current video blcx:k. 

The generation of the first local motbn vector LMV1 will be described below with reference to Figure 4A. 

55 In Figure 4A, first local motion vec^tor LMV1 is determined on the basis of the current vkjeo block within the 
current image and the first search area within the reference image. Here, the f iret search area has a smaller 
number of pbcels than that of the reference image, and has a position on an image corresponding to the current 
vkJeo block. In Figure 4A, the current video block Is represented as a hatched rectangular shape, and the first 
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reference video block having the same Image infbmnation as that of the current video block is represented as 
a hatched rectangular shape. Local nrK)tion estimator 54 compares a corresponding block having the same 
number of pixels as that of the cuoent video block and which is located on the left-upper end in the first search 
area and all blocks which are obtained by moving the corresponding block one-pixel by one-pixel to the right 

5 direction and/or to the down direction with the current video block. A method used for comparison is a well- 
known mean absolute error (MAE) method or mean square error (MSE) nrtethod. If the first reference video 
bk>ck having the least difference value from the current video block is determined by comparison of the pbcel 
values of the MAE or MSE. local nrK)tion estimator 54 generates a first local motion vector LMV1 representing 
spatial position difference between the first reference video block and the current vkJeo block. First local motion 

10 vector LM V1 is produced with respect to the respective current video blocks and the produced first motion vec- 
tor LMV1 is supplied to motion compensator 55. 

Motion compensator 55 discriminates that the pixel values of the compensated reference image are not 
stored in global nrration estimator 53, if first nnotion vector LMV1 is applied from motbn estimator 54. Based 
on such discrimination, motion compensator 55 generates the nK)tion-compensated pbcel values according to 

IS the pixel values of the reference image stored in frame memory 17 and the first k)cal motion vector LMV1 gen- 
erated in motion estimator 54. Subtracter 31 subtracts the corresponding pbcel values supplied from nrration 
compensator 55 from the respective pixel values of the current image supplied from memory 56 and outputs 
the difference value obtained by subtraction to transformer 11. The pbcel values output from nrwtion compen- 
sator 55 are also supplied to an adder 32, by which is added to the data output from inverse transformer 16. 

20 The pbcel values obtained by adder 32 are stored in frame memory 1 7 and used as the pbcel values of the ref- 
erence image for motion-compensating the following image. 

If first control signal CTL1 generated in nrK>tk>n discriminator 51 represents that motion estimation of the 
current image is not possible using the pixel values of the reference image, memory 56 repetitively supplies 
the pixel values of the current image one-frame by one-frame twice to switch 52. After memory 56 repetitively 

25 supplies the pixel values of the current innage twice to switch 52, the pixel values of the current image are also 
supplied to subtracter 31. Switch 52 supplies the pbcel values of firstly input one-frame current image among 
the pixel values of the two-frame current image supplied via input end C from memory 56 according to the 
applied second control signal CTL2, via a second output end B to local motion estimator 54. Then, switc^h 52 
supplies the pbcel values of the secondly applied cnirrent image via first output end A to local motk>n estimator 

30 54. Local motion estimator 54 does not generate a local motion vector during the time when the pbcel values 
of the current image are not supplied via switch 52. Subtracter 31 does not operate as well since the pbcel values 
of the current image from niemory 56 and the nrratnn-compensated pbcel values from motton compensator 55 
are not supplied thereto. 

Global motion estimator 53 generates a global motion vector GMV representing spatial position difference 
35 of the current image with respect to the reference image by using all the pbcel values of the current image ap- 
plied from second output end B of switch 52 and all the pbcel values of the reference image stored in frame 
memory 17. Global motion estimator 53 uses one among the following equations (1) according to the MAE 
method or following equation (2) according to the MSE method, to generate global motton vector GMV. The 
relationship between the reference image and the compensated reference image is conceptually shown in Fig- 
40 ure 4B. As can be seen from Figure 4B, global motion vector GMV represents the spatial position difference 
of the current image with respect to the reference image. 
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10 

Here, Ycur(m, n) represents the (m, n)^ pixel value in the current innage, and Yref(m, n) represents the (m, 
fif* pixel value in the reference image. Characters W and H represent the number of horizontal and vertical 
pixels, respectively. Expression x_rang and y_rang represent a movement range of the current image with re- 
spect to the reference image in the horizontal and vertical directions, respectively. That is, the current image 

15 can have a position with respect to the reference image within the range from -x_rang to x_rang&-1 of the ref- 
erence image in the horizontal direction. This is also same as that in the vertical direction. As shown in Figure 
4B, global motion estimator 53 receives and stores the pixel values of the compensated reference image having 
a reference position moved from frame memory 17, by moving a position of the reference Image by global mo- 
tion vector GMV. Actually, In case of pixels to be added to a newly compensated reference frame by movement 

20 of the reference frame among the pixel values of the compensated reference frame stored in global nrK>tion 
estimator 53. all pixel values are established into any one of the same values. Such a value can be set to a 
specific value of "0' or '255' in case of a pixel value representing 256 gradation. 

After global motion vector GMV and the compensated reference image have been completely determined 
by global motion estimator 53, the pbcel values of the current image supplied from memory 56 are supplied 

25 via switch 52 to local motion estimator 54. Local motion estimator 54 determines whether the pixel values of 
the compensated reference image are stored in global motion estimator 53, if the pixel values of the current 
image are applied via first output end A of switch 52. If global motion estimator 53 stores the pixel values of 
the compensated reference image according to the discrimination result, local motion estimator 54 uses the 
pixel values of the compensated reference image stored in global motion estimator 53 and the pixel values of 

30 the current image applied via switch 52, to generate a second local motion vector LMV2 with respect to the 
current video block. Since a generation process of second local motion vector LMV2 in local motion estinr^tor 
54 is similar to that of motion estimator 1 8 which determines the first reference video block with respect to the 
current y'tdeo block by using the pixel values stored in frame menrxM-y 17, the generation process thereof will 
be omitted. 

35 Local motion estimator 54 compares the pbcel values of the current video block with the pbcel values in a 
second search area of the compensated reference frame, and determines a second reference video block in 
the second search area having the same image information as that of the current vkieo block. Here, the second 
search area has a position which is moved by a value of global motk>n vector GMV from the first search area 
as shown in Figure 4B, and has a position corresponding to the current vkJeo block used for comparison within 

40 the compensated reference image as well. Local motnn estimator 54 generates second k>cal motk>n vector 
LMV2 representing spatial position difference between the current video block and the second reference video 
bbck, if the second reference video block is determined. The generated second local motion vector LMV2 is 
supplied to motk>n compensator 55. 

Motion compensator 55 uses the pixel values of the compensated reference image stored in global nrK>tion 

45 estimator 53 and the second local motion vector LMV2 to obtain the nrK}tk>n-compensated pbcel values with 
respect to the current video block if the second local motion vector LMV2 is applied thereto, and then outputs 
the obtained pbcel values to subtracter 31 and adder 32. Subtracter 31 subtracts the motion-compensated pbcel 
values supplied from motion cx)mpensator 55 from the pixel values of the (xirrent image supplied from memory 
56. Thereafter, since operatbn of the Figure 3 apparatus is the same as the nfK)tion compensation operation 

50 using the first local motion vector LMVI, the detailed description thereof will be omitted. The global motion vec- 
tor GMV and local motion vector LMVI or LMV2 generated in the Figure 3 apparatus are transmitted to a de- 
coder (not shown) for decoding the motion-compensated encoded image. 

In the case of the above-described embodiment, the apparatus of Figure 3 operates on the basis of the 
control signals according to the discrimination of motbn discriminator 51. It is, however, possible to provide 

55 other variations which are obtained by renrK>ving motk)n discriminator 51 and switch 52. The modified embodi- 
ment will be briefly described below referring to Figure 3. 

If memory 56 outputs the pixel values of the current image, global motton estimator 53 generates a global 
motion vector of the current image with respect to the reference image in the same manner as that described 
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referring to Figure 3. Global motion estimator 53 uses the generated global motion vector, motion-compensates 
the reference image, and stores the pixel values of the nK)tion-compensated reference image. 

Motion estimator 54 generates a local motion vector on the basis of the motion-compensated reference 
image stored in global motion estimator 53 and the pixel values of the current image applied from menrrary 
5 56. Motion compensator 54 uses the local motion vector and the pixel values stored in global nwtlon estimator 
53, to generate the motion-compensated pixel values. Thus, motion compensator 54 can generate the nrwtion- 
compensated pixel values properly as well when an amount of motion of the current Image with respect to the 
reference image is beyond a predetermined motion arTK)unt 

As described above, the motion compensation encoder adaptive to an amount of motion according to the 
10 present invention can determine a motion vector with respect to the respective video blocks in the current inv 
age, even when motion vectors with respect to the respective video blocks in the current Image cannot deter- 
mine using the search area determined in the reference image. Thus, a problem of increasing an anKXjnt of 
the transmission data occurring in the conventional motion compensatbn encoding system whteh perfbmns 
an intracoding operation because of no determinatbn of the motion vector with respect to an image having a 
15 large amount of motion, can be solved. 

While only certain embodiments of the Invention have been specifically described herein. It will be appa- 
rent that numerous nK>dif icatk)ns may be made thereto without departing from the spirit and scope of the in- 
vention. 

The reader's attentbn Is directed to all papers and documents which are filed concurrently with or prevkxis 
20 to this specif lcatk>n in connection with this application and whk:h are open to put>lk: Inspection with this spec- 
ification, and the contents of all such papers and documents are incorporated herein by reference. 

All of the features disclosed in this specif icatkin (Including any accompanying dalms. abstract and draw- 
ings), and/or all of the steps of any method or process so disclosed, may be combined in any combination, 
except combinattons where at least some of such features and/or steps are mutually exclush^e. 
^ Each feature disctosed in this specification (Including any accompanying dalms, abstract and drawings), 

may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stat- 
ed otherwise. Thus, unless expressly stated otherwise, each feature disdosed Is one example only of a generic 
series of equivalent or similar features. 

The invention is not restricted to the details of the foregoing embodlment(s). The inventton extends to any 
30 novel one, or any novel combinatk>n, of the features disdosed in this specif icatk)n (induding any accompa- 
nying dalms, at>stract and drawings), or to any novel one, or any novel combinatk)n, of the steps of any method 
or process so disdosed. 



35 Claims 

1 . A motion compensation encoding apparatus for use in an in^ge encoder for performing differential pulse 
code nrKKJulation by using pbcel values of a current image and nr>otk>n-compensated pixel values, said mo- 
tion compensatk)n encoder comprising: 
40 a first memory (1 7) for storing pbcel values of a reference image; 

a second memory (56) for storing pbcel values with respect to a plurality of Images, and repetitively 
outputting the stored pbcel values of each Image one-frame by one-frame at least twice; 

global motion estimation means (53) for generating a global motion vector representing spatial pos- 
ition difference between the reference image according to the pbcel values stored In the first memory (17) 
45 and the current image according to the pbcel values stored in the se(X)nd memory (56), motion-compen- 

sating the reference Image on the basis of the generated global nnotlon vector and storing the pbcel values 
of the nr>otk)n-compensated reference Image; 

local nnotion estimatk)n means (54) for generating a local nnotk>n vector acxx>rding to comparison 
of the pixel values between a current video block which is formed by the pixel values supplied from the 
50 second menK>ry (56), and which has a size smaller than the current image and a search area formed by 

part of the pbcel values stored in the global motion estimatbn means (53); 

motion compensation means (55) for recehnng the local motion vector from the local motion esti- 
matk>n means (54) and generating nrK>tion-compensated pbcel values by using the pixel values stored in 
the global motion estimation means (53) and the local motion vector; and 
55 means (31) for generating a difference value t)etween the respective pixel values of each image 

secondly output from the second memory (56) and the corresponding motk)n-compensated pbcel values 
output from the nrvotbn compensatk)n means (55). 
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A motion compensation encoding apparatus according to daim 1. wherein said global motion estiniator 
(53) generates said locai motion vector on the basis of a mean absolute emor value according to pixel 
difference values between a plurality of a respectively nrK>ved current image obtained by movenrwnt within 
the motion estimatbn range and the reference image. 

A motion compensation encoding apparatus according to daim 1, wherein said global nrration estimator 
(53) generates said local motion vector on the basis of a mean square error value according to pixel dif- 
ference values between a plurality of a respectively moved current image obtained by movement within 
the motion estimation range and the reference image. 

Amotion compensation encoding apparatus for use in an image encoder for performing differential pulse 
code nrKxlulation by using pixel values of a current image and motion-compensated pixel values, said mo- 
tion compensation encoder comprising: 

a first memory (17) for storing pixel values of a reference image; 

a second memory (56) for storing pixel values with respect to a plurality of images, outputting the 
stored pbcel values of each image one-frame by one-frame, and outputting again the pixel values of each 
in>age output one-frame by one-frame once or twice more on the basis of a first control signal; 

motion discrimination means (51), coupled to receive the firstly output one-frame pixel values 
among the duplicate pixel values of the same image output from the second memory (56), for discrimirv 
ating whether an amount of nrK)tion of the current image according to the pixel values supplied from the 
second memory (56) with respect to the reference image according to the pbcel values stored in the first 
memory (17), is beyond a predetermined anxHjnt of nK>tion, and generating first and second control sig- 
nals according to the discrimination result; 

global motion estimation means (53) for generating a global motion vector representing spatial pos- 
ition difference between the reference image according to the pbcel values stored in the first memory (17) 
and the current image according to the pbcel values stored in the second merTU)ry (56), and storing the 
pbcel values of the nx>tion-compensated reference image on the basis of the generated global motion vec- 
tor, 

local nwtion estimation means (54) for discriminating whether the nfK>tion-compensated reference 
image is stored in the global motion estimation means (53), and generating one of a first local motion 
vector according to comparison of the pbcel values between a current video block which is formed by the 
pbcel values supplied from the second menwry (56), and which has a size smaller than the current image 
and a first search area formed by part of the pixel values stored in the first menK)ry (17), and a second 
local nmtion vector according to (X)mparison of the pixel values between the current video block and a 
second search area fonmed by part of the pixel values stored in the global motbn estimation means (53), 
on the basis of the discrimination result; 

switching means (52) for outputting the pbcel values supplied from the second mennory (56) to the 
local nrK>tbn estimatk>n nrteans (54) if the second control signal generated in the nrK>tk>n discriminatk>n means 
(51) represents that the current image motkui amount is not beyor>d the predetermined motk)n amount, out- 
putting one-frame pixel values among the pixel values of the same image supplied from the second nriemory 
(56). if the second control signal represents that the current image motk)n amount is beyond the predeter- 
mined motion amount, and outputting the following one-frame pbcel values to the local motbn estinnation 
means (54); 

motion compensation means (55) for generating motbn-compensated pbcel values by using the pbc- 
el values stored in the first menrwry (17) and the first local motion vector if the first local motk>n vector is 
applied from the local nnotion estimation means (54), and generating nrK>tk}n-compensated pbcel values 
stored in the global nrration estimation means (53) and the second local motion vector, if the second local 
motk>n vector is applied from the local nrK>tion estimation means (54); and 

means (31) for generating a difference value t>etween the respective pbcel values of each image 
output from the second memory (56) and the ccnresponding nrK>tk>n-compensated pbcel values output from 
the motion (X)mpensation means (55). 

A motion compensation enccxling apparatus according to claim 4, wherein said second memory (56) out- 
puts the pbcel values of the current inuige one-frame by one-frame twice if the first control signal repre- 
sents that the cxjrrent image motion amount is beyond the predetenmined motion amount, while said sec- 
ond memory (56) outputs the pbcel values of the current image of only one frame if the first control signal 
represents that the fonmer is not l>eyond the latter. 
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Amotion compensation encoding apparatus according to claim 4 or claim 5, wherein said motion discrim- 
inator generates the first control signal according to a result whether the first reference video block having 
the same image information as that of the current video block exists in the first search area corresponding 
to the current video block. 

A motbn compensation encoding apparatus according to any of claims 4 to 6, wherein said motion dis- 
criminator discriminates whether the first reference video bk>ck having the same inrtage information with 
respect to a plurality of the current video block exists In the current image. 

A motion compensation encoding apparatus according to any of claims 4 to 7, wherein said global nrK)tion 
estimator (53) generates said first local motion vector on the basis of a mean absolute error value ac- 
cording to pixel difference values between a plurality of a respectively nrK>ved current Inrage obtained by 
movement within the nrration estimation range and the reference image. 

A nrK>tion compensation encoding apparatus according to any of dainns 4 to 7, wherein said global motion 
estimator (53) generates said first local motion vector on the basis of a mean square error value according 
to pixel difference values between a plurality of a respectively moved current Image obtained by nrvove- 
ment within the nx)tion estimation range and the reference innage. 

10. A nrK)tion compensation encoding apparatus according to any of dainr^ 4 to 9, wherein said local motion 
^ estimator (54) generates said first local motion vector if the motk>n-compensated reference image Is not 

stored in sakl global nnotion estimator (53), while the former generates said second local motion vector 
if the motiorv-compensated reference image is stored in said latter. 

11. A nrK)tlon compensation encoding method for use in an inr^ge encoder for performing differential pulse 
25 code nrKKJulation by using pixel values of a current image and motion compensated pixel values, said mo- 
tion compensatbn encoding nrwthod comprising the steps of: 

a) storing pixel values of a reference image for nriotion compensatk)n; 

b) storing pixel values of the current image; 

c) discriminating whether an anrKMjnt of motion of the current image to be motk>n-compensated Is be- 
30 yond a predetermined amount of motion on the basis of all the pixel values stored in steps a) and b); 

d) generating a global motion vector representing spatial positbn difference of the current image of 
the pixel values stored in step b) with respect to the reference image of the pixel values stored in step 

a) , if a discrimination result of step c) represents that the current Image motton anrtount Is beyond the 
predetermined nrwtion amount; 

^ e) motion compensating the reference In^ge corresponding to the pixel values stored in step a) to store 

the pixel values of the motion-compensated reference image; 

0 generating a second local motk)n vector on the basis of comparison of pixel values between a first 
video block and a second search area fonmed by part of the pixel values stored in step e); 

g) generating motion-compensated pixel values by using the second local motion vector generated in 
^ step f) and the corresponding pbcel values stored in step e); and 

h) generating a difference value between the respective pixel values of the current image stored In 
step b) and the corresponding pixel values of the motion-compensated reference Image generated in 
step g). 

45 12. A motion compensatk>n encoding method according to daim 11, further comprising the steps of. 

i) generating a first local motion vector on the basis of comparison of the pixel values between the first 
video block which is formed by the pixel values stored in step b) and having a smaller size than that of 
the current image and a first search area formed by a part of the pixel values stored in step a); 

j) generating the motion-compensated pixel values using the first local motion vector generated in step 
50 i) and the corresponding pbcel values stored in step a); and 

k) generating a difference value between the respective pixel values of the current inr>age stored In step 

b) and the corresponding pixel values of the nrK)tion-compensated reference image generated in step 
j). 

wherein a discrimination result of step c) represents that the current image motion anx)unt is not 
55 beyond the predetermined motion anrKHjnt 

13. The nnotion compensatbn encoding method according to daim 11 or daim 12, wherein said step c) conv 
prises the sut>-steps of. 
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c1 ) forming the first search area for motion estimation of the current video block, and including the cur- 
rent video block having a part of the current image pbcel values and a part of the pUel values stored in 
step a); 

c2) discriminating whether the reference video block having the same innage Information as that of the 
5 current video block exists in the first search area on the basis of comparison of the image infonmation 

between the current video block pbcel values formed in sub-step cl) and the corresponding blocks which 
exist in the first search area and having the same number of pbcels as that of the current video block; 
and 

discriminating whether the current Image woWon amount is beyond the predetermined nrration 
10 amount on the basis of the discrimination result of sub-step c2). 

14. A motion compensatk>n encoding method according to claim 1 3, wherein said sub-step c2) further conv 
prises the sut>-step of discriminating whether the first reference video block having the same image in- 
fonmatbn with respect to a plurality of the current video blocks exists in the current image. 

15 

1 5. A motion compensation encoding method according to any of claims 11 to 14, wherein said step d) further 
comprises the sub-step of dl) generating the glot>al nrK)tion vector o the basis of a mean absolute error 
value according to pixel difference values between a plurality of a respectively nrraved current image ot>- 
tained by movement of the current image within the predetermined nrK>tion estimation range and the ref- 

^ erence image. 

1 6. A motk)n compensation encoding method according to claim 1 5, wherein sakJ sub-step dl) comprises the 
sub-step of dal) calculating the mean absolute error value of the pbcel difference values between one cur- 
rent image by noovement using the following equation and the reference image, 
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MV(k, 1) = min li'cur -'^ "^re/^'"'^^ 



-x_rang s k s x_rang-l, 
-y_rang sis y_rang-l 

in which Ycv(m, n) represents the (m, n)"> pbcel value in the current image, and Yj^m, n) represents 
the (m, n)") pbcel value in the reference Image, characters W and H represent the number of horizontal 
and vertical pbcels, respectively, and expressk>ns x_rang and y_rang represent a movement range of the 
current image with respect to the reference image in the horizontal and vertical directions, respectively. 



1 7. Anrwtion compensation encoding method according to any of claims 1 1 to 1 6, wherein step d) f urther corrv 
prises the sut>-step of d2) generating the glot>al nrK>tion vector on the bass of a mean square error value 
according to pixel difference values between a plurality of a respecrtively moved current image obtained 
by movement of the current image within the predetermined nDotton estimatton range and the reference 
image. 

45 

18. A motion compensation encoding method according to daim 1 7, wherein saki sub-step d2) comprises the 
sub-step of da2) calculating the mean square error value of the pixel difference values between one cur- 
rent image by nnovement using the following equation and the reference image, 

50 
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Wik, 1) = min ^^\Y^^{m*k,n^ 1) -Y,^^(in,n) \K 

-x_rang s k s x_rang-l, 
-y_rang sis y_rang-l 

in which YcJ^n* represents the (m, vif* pixel value in the cun^nt image, and Yr^tn, n) represents 
the (m. ny^ pixel value in the reference image, characters W and H represent the number of horizontal 
and vertical pixels, respectively, and expressions x_rang and y_rang represent a nru)vement range of the 
current image with respect to the reference image in the horizontals and vertical directions, respectively. 
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